The Question Answering System of DCUMT in NTCIR-11 QALab
نویسندگان
چکیده
This paper describes the question answering system developed at Dublin City University for participation in the QA Lab shared task in NTCIR-11 [20]. We participated in three tasks: center exam (multiple choice) tasks in Phases 1 and 2, and secondary exam task (written) in Phase 2. We built a QA system in which we use the specialized-purpose parser KBarse to acquire meaning representation which is called case frame graphs from history textbooks using commonsense knowledge. We used distributed representation for Out-Of-Vocaburary (OOV) words and missing assertions. We added prototype functionality for handling implicit arguments/relations, causality analysis, time analysis, and temporal order analysis by heuristics. Our results for center exam task in Phase 1 was 77.0 which was the first among seven submissions, for center exam task in Phase 2 was 72.0 which was the first among nine submissions, and for secondary exam task in Phase 2 in terms of precision were 71.4 (UTokyo), 62.5 (KyotoU), 71.8 (Hokkaido), 62.7 (Waseda), and 80.0 (Chuo) which were the first among two submissions.
منابع مشابه
CMU Multiple-choice Question Answering System at NTCIR-11 QA-Lab
We describe CMU’s UIMA-based modular automatic question answering (QA) system. This system answers multiplechoice English questions for the world history entrance exam. Questions are preceded by short descriptions providing a historical context. Given the context and question-specific instructions, we generate verifiable assertions for each answer choice. These assertions are evaluated using se...
متن کاملSML Question-Answering System for World History Essay Exams at NTCIR-13 QALab-3
This paper describes SML team’s question-answering system for world history short essay-type question at NTCIR-13 QALab-3 [1]. Our system consists of an extraction module and an compression module. In the extraction module, we identify the theme and the focus of a question, and extract several sentences from a glossary of world history that are appropriate for the theme and the focus. In the co...
متن کاملWUST System at NTCIR-12 QALab-2 Task
This paper describes our question answering system at NTCIR-12 on QALab-2 task, which requires solving the history questions of Japanese university entrance exams and their corresponding English translations. Wikipedia of English edition is main external knowledge base for our system. We first retrieve the documents and sentences related to the question from Wikipedia. Then, the classification ...
متن کاملSML Question-Answering System for World History Essay and Multiple-choice Exams at NTCIR-12 QA@Lab-2
This paper describes SML team’s approach to automatically answering world history exam questions at NTCIR12 QALab. We challenged to answer both the multiplechoice questions in the national center tests and the essaytype questions in the secondary exams. Our system answers the questions by searching based on surface similarity. We explored several methods to enhance the system with domain-specif...
متن کاملUsing Time Periods Comparison for Eliminating Chronological Discrepancies between Question and Answer Candidates at QALab NTCIR11 Task
This paper reports on our approach to the NTCIR-11 QALab task of answering questions from Japanese National Center Examinations for University Admissions. Our approach aims at identifying and comparing periods of world history in both the questions and the answer candidates. We created and applied a date identification method, which checks for temporal overlaps between time periods in questions...
متن کامل